Skip to content

Document global placement, GPU preference lists, and global storage#298

Merged
kylegani merged 7 commits into
masterfrom
multi-region-placement-docs
Jul 20, 2026
Merged

Document global placement, GPU preference lists, and global storage#298
kylegani merged 7 commits into
masterfrom
multi-region-placement-docs

Conversation

@kylegani

@kylegani kylegani commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Summary

Second PR of the intent-based placement docs work (follows #296).

Multi-Region Deployment rewrite (deployments/multi-region-deployment.mdx, same path and nav slot):

  • region = "global" as the recommended default: platform places the app in any region with capacity matching its hardware requirements; new regions become eligible without a redeploy
  • Pinning a region, with the capacity/queueing tradeoff stated
  • Geography-based placement (US/EU) marked as coming soon
  • Regions confirmed against the live production GPU availability matrix: self-serve us-east-1, us-central1, eu-north-1, eu-north1; the rest on request. eu-north-1 vs eu-north1 disambiguation; provider = "nebius" requirement for non-AWS pins. No Crusoe regions listed.
  • Routing behavior: warm capacity anywhere before cold start, soft latency preference, no session affinity
  • Scaling params are app-wide; platform distributes across regions
  • Storage: regional volumes plus /global-persistent-storage for global apps

Shipped but undocumented config now covered:

  • compute preference lists (up to 5 types, one hardware family, cerebrium run uses first entry) in using-gpus + TOML reference
  • provider/region optional with platform-selected defaults; Complete Example uses region = "global"

Storage fixes (verified against latest CLI v2.5.3 / backend / infra tips, plus live CLI tests):

  • New Global Storage section in managing-files: --region global file commands work end to end, per-region read caches, no dashboard listing/resize for the global volume
  • Regional isolation claim softened to "not guaranteed to be available in other regions" (volumes are not all physically isolated across regions)
  • rm directory syntax requires a trailing slash; resize endpoint corrected to the verified PATCH /v2 route with default-<region> volume id and 50GB-1TB bounds; stale 50GB default removed
  • faster-cold-starts: per-region cache behavior and global-volume guidance for multi-region apps

Also: secrets documented as available in every region an app runs in; introduction reframed to "deploy once and run across multiple regions".

Open items (flagged during review, need product/eng confirmation)

  • Crusoe us-east-1 remains deployable in the live availability matrix for anyone setting provider = "crusoe", even though docs no longer mention it; align deploy validation if it should be retired
  • us-west-2, ap-south-1, and the five new AWS regions (Tokyo, Frankfurt, São Paulo, Montreal, Dubai) exist in latest backend code but not in the live prod matrix; docs list them as on-request
  • BLACKWELL_B300 is listed for us-east-1 but absent from deploy validation (live and latest code)
  • Backend ExcludedRegions does not gate us-west-2/eu-west-2, which docs list as on-request
  • Regional volume physical sharing (us-east-1/us-east-2/us-west-2/us-central1 share a volume; eu-north1 shares eu-north-1's): is this the intended contract? Matters for the residency story.
  • Intended customer-facing default volume size (50GB claim was stale; PVC request is now 1TB; enforced quota configured outside the repos)

🤖 Generated with Claude Code

Rewrite Multi-Region Deployment around intent-based placement:
region = "global" (recommended) or pin a region, geography placement
marked coming soon, routing behavior (warm capacity first, soft latency
preference, no session affinity), app-wide scaling semantics, and the
region list and GPU availability table rebuilt from deploy validation
(4 self-serve regions, 10 on request).

Document shipped-but-undocumented config:
- compute accepts a preference-ordered list of up to 5 types (one
  hardware family; cerebrium run uses the first entry)
- provider and region are optional; defaults are platform-selected

Storage, verified against latest CLI/backend/infra tips and live CLI:
- Global storage: /global-persistent-storage mount, --region global
  file commands, per-region read caches
- Soften regional isolation claim to "not guaranteed available in
  other regions" (regional volumes are not all physically isolated)
- Fix rm directory syntax (trailing slash required), resize endpoint
  (PATCH /v2, volume id default-<region>), drop stale 50GB default

Secrets are documented as available in every region an app runs in.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@kylegani
kylegani requested a review from milo157 as a code owner July 15, 2026 16:04
@mintlify

mintlify Bot commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
cerebrium 🟢 Ready View Preview Jul 15, 2026, 4:06 PM

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread deployments/multi-region-deployment.mdx Outdated
…ive API

Self-serve regions (us-east-1, us-central1, eu-north-1, eu-north1) all
confirmed present in the production GPU availability matrix.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
kylegani and others added 2 commits July 17, 2026 12:32
The region list already names eu-north-1 (Stockholm) and eu-north1
(Finland) as separate regions.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread deployments/multi-region-deployment.mdx
Comment thread deployments/multi-region-deployment.mdx Outdated
memory = 8.0
```

Pinning guarantees placement but limits the app to that region's capacity, which increases the likelihood of request queuing when the region is busy.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"guarantees placement in that region"

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will fix

Comment thread deployments/multi-region-deployment.mdx Outdated
Comment thread deployments/multi-region-deployment.mdx Outdated
Comment thread deployments/multi-region-deployment.mdx
Comment thread storage/managing-files.mdx Outdated
Comment thread storage/managing-files.mdx Outdated
- Pinning wording: guarantees placement in that region
- Routing: requests enter through the closest region, then route to
  warm capacity
- Storage wording extends to multi-region placement: one independent
  regional volume per region an app runs in
- Replace storage pricing figures with a pricing page link
- Note the global volume size (1TB)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
When omitted, the platform chooses placement automatically based on
the app's hardware requirements.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@kylegani
kylegani merged commit 0edc1fb into master Jul 20, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants